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[57] ABSTRACT 

The present invention provides a transcoder for transcoding 
of digitally encoded bit streams produced by predictive 
encoders. The transcoder of this invention is less complex 
than previously known transcoders in terms of both com- 
putational and storage requirements. This efficiency is 
achieved by combining decoding and re-encoding steps into 
one step. This one-step transcoding is accomplished by 
modifying the originally quantized vectors and then requan- 
tizing and noiseless encoding these vectors into a bit stream 
in accordance with a predetermined objective. 

36 Claims, 6 Drawing Sheets 
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EFFICIENT TRANSCODING DEVICE AND 
METHOD 

FIELD OF THE INVENTION 

This invention relates generally to transcoding of digitally 
encoded signals, and more particularly to transcoding of 
signals that are digitally encoded by predictive coders. 

BACKGROUND {Q 

A predictive waveform encoder is a device for compress- 
ing the amount of information in a waveform (e.g., speech, 
image or video) by removing the statistical redundancy 
among its neighboring samples using prediction methods. 
Several ITU-T Recommendations for speech coding (ITU-T 15 
stands for the Telecommunication Standardization Sector of 
the International Telecommunication Union; ITU-T is for- 
merly known as CCITT, or International Telegraph and 
Telephone Consultative Committee), have adopted predic- 
tive coding techniques (for example, differential pulse-code 20 
mudulation, or DPCM, is used in Recommendation G.721). 
In these predictive speech coders, an original speech sample 
is predicted based on past speech samples, and the prediction 
error (the difference between the original and the predicted 
samples), instead of the original sample, is quantized, and 25 
then digitally encoded by a noiseless coder to a bit stream. 
Since the energy of the prediction error is, on average, much 
smaller than the original speech signal, a high compression 
ratio can generally be obtained. 

Predictive coding methods have also been used for image 30 
and video compression. In these applications, the spatial 
correlation among neighboring pixels in an image and, in the 
case of video, the temporal correlation between successive 
images can be exploited. 

Topical predictive coders perform the prediction based on 
a replica of the reconstructed waveform. This ensures that 
the quantization error does not accumulate during recon- 
struction. Although the prediction accuracy is reduced (for 
coarse quantization), overall compression performance is ^ 
generally improved. 

State-of-the-art digital video coding systems utilize trans- 
form coding for spatial compression and a form of predictive 
coding known as motion-compensated prediction (MCP) for 
temporal compression. Video compression techniques that 45 
have recently been adopted in international standards (e.g., 
the MPEG standard developed by the International Stan- 
dards Organization's Motion Picture Experts Group (ISO's 
MPEG) and ITU-T's H.261), or others that are under 
consideration for future standards, all employ a so-called 50 
block-matching MCP technique. In this method, each image 
in a video sequence is partitioned into NxN blocks, called 
macro blocks (MB's), where N is a predetermined integer. 
For each MB, a replica of the previously decoded image is 
searched to find an NxN window that best resembles that 55 
MB, and the pixels in that window are used as a prediction 
for that MB. The prediction error is then encoded using a 
combination of transform coding and scalar quantization 
followed by variable-length noiseless encoding. 

Transcoding will be required in many applications of 60 
compressed digital video. For example, in some instances, it 
may be desirable to change the rate of a digital video bit 
stream in the network. Alternatively, when constant bit-rate 
(CBR) video traffic is to be carried over a cell-relay or 
Asynchronous Transfer Mode (ATM) network, it may be 65 
desirable to convert the CBR stream into a variable bit-rate 
(VBR) stream to save bandwidth through statistical multi- 
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plexing. Transcoding may also be required for conversion 
between two video compression formats. For example, it 
may be necessary to convert an MPEG-encoded video bit 
stream into an H.261 bit stream, or vice versa. Another 
important application of transcoding is multipoint video 
conferencing; here, transcoding may be needed to imple- 
ment video mixing for continuous presence multipoint 
bridging. 

FIG. 1, numeral 100, is a block diagram schematic of a 
predictive waveform encoder as is known in the art. A 
sequence of vectors consisting of a group of samples r, taken 
from an original waveform arc processed to generate a 
sequence of quantized vectors Y„ where i=0, 1 , ... is a time 
index indicating the order in which the input vectors are 
processed, TTie dimensionality L of the input vectors is 
arbitrary. In typical speech applications L=l, whereas in 
many video compression applications, L>1. 

The encoder operates iteratively such that: (1 ) a predictor 
unit (102) generates a prediction of the input vector r, 
represented by the vector p, based on one or more past 
reconstructed vectors z Jf j<i, using a predetermined linear 
prediction operator P,; (2) the vector p, is subtracted from r, 
at a first combiner (104) to obtain the prediction error vector 
e—Tf-p,, wherein the predictor P, is typically chosen to 
minimize the average energy of the prediction error e t ; (3) 
the prediction error vector e, is transformed by a transfor- 
mation unit (106) according to E^A^eJ, where A,[ ] rep- 
resents a linear transformation; (4) the vector E, is quantized 
using a quantizer Q, (108) to obtain the quantized vector 
YpE^D,., where D ; is a quantization error vector, and the 
quantized vector Y ; is encoded into a binary word using a 
noiseless encoding method (e.g., a Huffman code), and then 
it is transmitted or stored; (5) the quantized vector Y f is then 
inverse transformed at Inverse Transformation Unit Ar* 
(110) to find the vector y^A/^YJ, where A, _1 [ ] is an 
inverse transformation (i.e., A, -1 [A,[xl]=x); and (6) the 
vector p, is added by a second combiner (112) to y, to obtain 
the reconstructed vector zpy^p,, which is stored for use in 
later iterations. 

In most applications, the transformation A, is fixed a 
priori, i.e., is predetermined, whereas and P, are varied 
using preselected adaptation algorithms. In some applica- 
tions, the transformation A, is not used; then Apl, where 1 
is an LXL identity matrix. In so-called forward adaptation, 
the parameters of Q„ P, and A f are passed to the decoder as 
side information, while in so-called backward adaptation, 
Q,, ?f and A, are determined at the decoder from previously 
received information, so no side information needs to be 
sent. 

Given the information on Q„ P, and A,, a decoder can 
reconstruct the vector z,. The decoder (200) first recovers the 
quantized vectors {Y,} from the received bit stream by 
decoding the noiseless source code and then obtains z ( . As 
shown in FIG. 2, numeral 200, (1) the quantized vector Y, 
is first inverse transformed using the inverse transformation 
unit A,- -1 (202) to obtain y=Af '[YJ; (2) a predictor (206) 
obtains the prediction p, of the input vector r, from one or 
more past reconstructed vectors z y , j<i, using the prediction 
operator ? it as in the encoder; and (3) a combiner (204), 
operably coupled to the predictor (206) and to the transfor- 
mation unit (A, -1 ) (202) adds the vector p, to y, to obtain the 
reconstructed vector z v 

The reconstructed vector z ( can be represented as z^-Kl,, 
where d^A^^DJ is an inverse-transformed version of the 
quantization error vector D f . In other words, z, differs from 
the original vector r t only by d=A,- -) [DJ. To obtain good 
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performance, the transformation A, is chosen such that the 
error A," 1 [DJ, or an appropriately weighted version of it, is 
kept small. 

A transcoder first recovers the sequence of quantized 
vectors {Y,} from the received bit stream by decoding the 
noiseless source code, converts {YJ into a sequence of 
transcoded vectors {Y/} ( and then generates a new bit 
stream representing {Y/} using the noiseless source code. 
The transcoder has full knowledge of the operators Q„ A, 
and P, used at the original encoder and decoder, either a 
priori or through received side information. 

In prior art "decode and re-encode" transcoding, a quan- 
tized vector Y, is first decoded using the decoder of FIG. 2 
to obtain the reconstructed vector z=r,+d r . and then z ( is 
re-encoded using an encoder, possibly with a different 
quantizer Q/, a different predictor P/ or even a different 
transformation A/, to obtain the transcoded vector Y,\ The 
transcoded vector can be decoded by the decoder of FIG. 2 
using Q/, P," and A/. The final reconstructed vector z/ can 
then be represented as z/^-K^+d/, where d/KA/T'lQ/] 
a transformed version of the quantization error introduced 
by the transcoder. 

Although conceptually straightforward, the implementa- 
tion of the decode and re-encode method can be quite costly 
because of its high computational and storage requirements. 
Thus, there is a need for an efficient transcoding device and 
method that can be implemented with low complexity. 

SUMMARY OF THE INVENTION 

A device and method provide transcoding a sequence of 
quantized vectors Y f generated by a predictive waveform 
encoder utilizing modified quantization error vectors S,. The 
device includes: (1) an adder that is operably coupled to 
receive at least a first quantized vector Y, and at least a first 
modified quantization error vector S, and is used for gener- 
ating a difference vector E^Y^S, between the quantized 
vector Y, and the modified quantization error vector S,; (2) 
a quantizer that is operably coupled to the adder and is used 
for quantizing the difference vector E/ to obtain a transcoded 
vector Y/; (3) a quantization error vector calculator (QEVC) 
that is operably coupled to receive at least two of the vectors 
Y„ E/ and Y/ and is used for generating the inverse- 
transformed error vector d^A^MD/], where D/ is a quan- 
tization error vector and A, -1 is an inverse transformation; 
and (4) modifying circuitry that is operably coupled to the 
QEVC and is used for generating the modified quantization 
error vector S, based on past values of the vector d/, where 
Sj is input to the adder. 

BRIEF DESCRIPTIONS OF THE DRAWINGS 

FIG. 1 is a block diagram schematic of a predictive 
waveform encoder as is known in the art. 

FIG. 2 is a block diagram schematic of a decoder that 
typically operates in conjunction with an encoder of FIG. 1, 
as is known in the art. 

FIG. 3, numeral 300, is a general block diagram schematic 
of a system for transcoding. 

FIG. 4 is a block diagram schematic of a device in 
accordance with the present invention. 

FIG. 5 is a block diagram schematic of the device of FIG. 
4 shown with greater particularity. 

FIG. 6 is an alternative block diagram schematic of the 
device of FIG. 4 shown with greater particularity. 
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FIG. 7 shows a typical configuration of an H.261 video 
encoder, as is known in the art. 

FIG. 8 illustrates the partition of an image into increas- 
ingly smaller blocks in the H.261 standard. 

FIG. 9 shows the indexing of the coefficients in the 
transform domain for the H.261. standard. 

FIG. 10 shows a block diagram schematic of one embodi- 
ment of the one-step transcoder of the present invention. 

FIG. 11 is a block diagram schematic of an H.261 decoder 
as is known in the art. 

FIG. 12 is a flow chart of one embodiment of steps in 
accordance with the method of the present invention. 

DETAILED DESCRIPTION OF A PREFERRED 
EMBODIMENT 

FIG. 3, numeral 300, is a general block diagram schematic 
of a system for transcoding as is known in the art. The input 
of the transcoder (304) is a bit stream generated by a 
predictive waveform encoder (302) such as the H.261 video 
encoder. Its output is another bit stream which can be 
decoded by a predictive waveform decoder (306). The 
transcoder (304) modifies the bit stream according to a 
predetermined objective. 

The transcoder device of the present invention, referred to 
herein as a "one-step transcoder," achieves the performance 
of the "decode and re-encode" transcoder with only two 
transformations and one prediction operation, provided that 
the predictor P/ and the transformation A/ used in the 
transcoder are the same as the operators P, and A, used in the 
original encoder, thus decreasing complexity in the 
transcoding operation. In addition, the one- step transcoder 
reduces the storage requirements. 

In the one-step transcoder, shown in a block diagram 
schematic in FIG. 4, numeral 400, a modified version S f of 
the quantization error vector is subtracted from the received 
quantized vector Y f , and the difference vector E/ is re- 
quantized to obtain the transcoded vector Y/. A quantization 
error calculator then computes the inverse-transformed 
quantization error vector d/=A i ~ 1 [D/l, where D/=Y/-E/ is 
the quantization error vector and A, -1 is an inverse trans- 
formation. A modifying circuitry deterrnines the modified 
quantization error vector S, based on past vectors dy, j<i. 

The present invention includes a device for transcoding a 
sequence of quantized vectors Y, generated by a predictive 
waveform encoder utilizing modified quantization error vec- 
tors S f .. The device (400) includes an adder (402), a quantizer 
(404), a quantization error vector calculator (QEVC) (406), 
and modifying circuitry (408). The adder (402) is operably 
coupled to receive at least a first quantized vector Y, and at 
least a first modified quantization error vector S ( and is 
utilized for generating a difference vector E/=Y'-S, between 
the quantized vector Y, and the modified quantization error 
vector S f , The quantizer (404) is operably coupled to the 
adder (402) and is used for quantizing the difference vector 
E- to obtain a transcoded vector Y/. The quantization error 
vector calculator (QEVC) (406) is operably coupled to 
receive at least two of the vectors Y„ E/ and Y/ and is 
utilized for generating the inverse-transformed error vector 
d/=A, _1 [D/], where D/ is a quantization error vector and 
A," 1 is an inverse U-ansformation. The modifying circuitry 
(408) operably couples the QEVC (406) to the adder (402) 
and is used for generating the modified quantization error 
vector S, based on the past values of the vector d,\ 

In an alternate embodiment, the transcoding device of the 
present invention may be selected to include an adder (402), 
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a generalized quantizer (410), and modifying circuitry (408). 
In this implementation, the adder (402) is operably coupled 
to receive at least a first quantized vector Y, and at least a 
first modified quantization error vector S, and is used for 
generating a difference vector E-~Y r Si between the quan- 3 
tized vector Y, and the modified quantization error vector S ( ; 
the generalized quantizer (410) is operably coupled to the 
adder (402) and is used for quantizing the difference vector 
E/ to obtain a transcoded vector Y/, and f or receiving at least i 0 
one of the vectors Y, and E/ and generating an inverse- 
transformed error vector d^A'^D/], where D/ is a quan- 
tization error vector and A, -1 is an inverse transformation; 
and the modifying circuitry (408) is operably coupled to the 
generalized quantizer (410) and is used for generating the 15 
modified quantization error vector S, based on past values of 
the vector d/. 

One embodiment of the one- step transcoder device of 
FIG. 4 is shown with greater particularity in FIG. 5, numeral 20 
500. The device includes a first adder (502), a quantizer 
(504), a quantization error vector calculator (QEVC) (506) 
that includes a second adder (510) coupled to an inverse 
transformation unit (512), and modifying circuitry (508) that 
includes a predictor (514) coupled to a transformation unit 
(516). The first adder (502) and the quantizer (504) are 
coupled as shown for the adder (402) and the quantizer 
(404), respectively, of FIG. 4. The second adder (510) is 
operably coupled to receive vectors E/ and Y/ and is utilized 30 
for generating the quantization error vector D/. The inverse 
transformation unit (512) is operably coupled to the second 
adder (510) and is utilized for generating the inverse- 
transformed error vector d/=A ( _I [D/J, where D/ is a quan- 
tization error vector and A,~ l is an inverse transformation. 35 
The predictor (514) of the modifying circuitry (508) is 
operably coupled to the inverse transformation unit (512) of 
the QEVC (506) and generates the predicted quantization 
error vector s t . The transformation unit (516) is operably 
coupled to the predictor (514) and is used for transforming 40 
the predicted quantization error vector s, to vector S ( as 
described more fully below and providing the modified 
quantization error vector S y to the first adder (502) based on 
past values of the vector d/. 

45 

Past inverse-transformed quantization error vectors d/= 
A j<i, are passed through the prediction operator P, 

to obtain the the predicted quantization error vector s,. The 
vector s, is transformed again to obtain the modified quan- 
tization error vector S|=A,[s,J. Then the vector S, is sub- 50 
tracted from the received quantized vector Y, to obtain the 
error vector E/=Y f -S,. The error vector E/ is quantized 
using the quantizer Q/ (504) to obtain the transcoded vector 
Y/=E/+D/, where D/ is the quantization error vector intro- 
duced by the transcoder The transformed quantization error 55 
vector d/ is obtained by first subtracting the vector E/ from 
Y/ (using the second adder (510)) to obtain the quantization 
error vector D,'=E/+Y/, and then transforming D/ (using the 
inverse transformation unit (512)) to obtain d/=A / " , [D ( ']. 

The one-step transcoder generates the same transcoded 
sequence {Y/} as the decode and re-encode transcoder. This 
can be shown by proving that the signal at the input of the 
quantizer is the same in both cases: 

First consider the decode and re-encode transcoder. In this 65 
case, the input to the quantizer in the re-encoder can be 
written as 
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= Zi-AAty + dpi + dpil 

where Z/=A ( [zJ is a transformed version of the decoder 
output z,- (in the transcoder) and r pi -, d p/ and d pi ' represent the 
outputs of the predictor P, at time i if excited individually by 
the sequences {r,}, {dj and {d/}, respectively. 

Similarly, the input of the quantizer in the one-step 
transcoder can be written as 

= Zi-AArn + dpft-Md*). 

Since A, is a linear operator, it follows that B =C,. 

The present invention relies on the fact that the quantized 
vector Y ( can be re-quantized without any error accumula- 
tion in the reconstruction, provided that a modified quanti- 
zation error vector S t - is added to Y, before rc-quandzation. 
This compensates for the transcoder quantization error 
added by the prediction loop in the reconstruction. 

The one-step transcoder of the present invention can also 
be implemented in other ways. One alternative structure is 
shown in FIG. 6. 

FIG. 6, numeral 600, sets forth a block diagram schematic 
of an implementation of a device in accordance with the 
present invention wherein the difference between the input 
Y, and the output Y/ is fed through the feedback loop. The 
quantization error vector calculator (606) includes a second 
adder (610) that is operably coupled to receive Y, and Y/ for 
obtaining said difference {X,}, an inverse transformation 
unit (612) that is operably coupled to the second adder (610) 
for providing vector x ; , and a third adder (614) for receiving 
and combining x ( and s,, and modifying circuitry (608) that 
includes a predictor (616) that is operably coupled to the 
third adder (614), for utilizing d/ to provide the predicted 
quantization error vector s„ and a tranformation unit (618) 
that is operably coupled to the predictor (616), for generat- 
ing modified quantization error vector S f . The difference in 
the implementation of FIG. 6 lies in the way the trans formed 
quantization error vector d/ is generated: 

The input vector Y, is subtracted from the transcoded 
vector Y/ to obtain the vector X^YZ-Y,, which is then 
transformed to find x^A t ~ l [X t ']. The predicted quantization 
error vector s, is added to x, to determine d/=x,+s,. 

That the inverse-transformed quantization vector d/ is the 
same in both structures can be shown by noting that the 
vector x, in FIG. 6 can be written as 

Therefore, the implementations of FIGS. 5 and 6 provide the 
same performance. 

The one-step transcoder may also be utilized to change 
the rate of a bit stream generated by a video encoder 
operating according to the ITU-T Recommendation H.261. 
First, a typical configuration of an H.261 encoder is shown 
in FIG. 7, numeral 700. 

The input to the encoder consists of a sequence of images 
scanned progressively at a nominal image rate of about 30 
images per second. Each image consists of a luminance 
component Y and two color difference components CB and 
CR, sampled according to one of two formats, CD 7 (802) and 
QCIF (804), wherein: 
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Each image is partitioned into increasingly smaller seg- 
ments as illustrated in FIG. 8, numeral 800. CIF images are 
divided into 1 2 Group Of Blocks (GOB's) and QCIF images 
are divided into three GOB's. Each GOB (806) consists of 
33 macro blocks (MB's), and a MB consists of four lumi- 
nance blocks (808) and two color difference blocks (810, 
812), where each block has 64 pixels (814) arranged on an 
8x8 grid. Each pixel is represented by an integer between 1 
and 254. 

MB's are the fundamental coding elements in H.26. The 
six 8x8 blocks in a MB are numbered from 1 to 6 as shown 
in FIG. 8. Let r, represent the pixel in position (m,n) in 

the k'th block of the i'th MB, where i=0, 1 k=l 

, 6 and m, n=0, 1, .... 7. Then the input vector r f for the i'th 
MB can be represented as: 
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variables. Note that the same transformation A[ ] is used in 
CIF: 352 x 288 (Y), i76x 144 (CR), 176 x 144 (CB) evcry MB. FIG. 9, numeral 900, shows how the indices t 
qcif: 176 x 144 (Y), 88 x 72 (CR), 88 x 72 (CB). (902) and s (904j, both in the range 0 to 7 t are used in the 

transform domain. 

A quantizer (716) is operably coupled to receive the 
transform coefficients E and quantizes the coefficients 
using a scalar quantizer w&ch is uniform with step size A t 
except for a dead-zone around 0. The reconstruction values 

of the quantizer are {0, ±a,, ±(a,+A,), ±(a,+2A t ) 

-2O48£±(a,+126A,)<2048}. where A,=2, 4, . . . , 62 and 
a=3A/2 when A, is odd and a~3A /2-1, otherwise. The 
same step size A, is utilized for all transform coefficients in 
the MB, except in the intra mode, the sample E i;wo is 
quantized using a uniform scalar quantizer of step size A^=8 
with no dead-zone (also, since E^ o0 S0, only the positive 
reconstruction values are needed in this case). The decision 
regions of the quantizer are selected to improve the image 
quality as much as possible. 

The output of the quantizer (716) is the quantized trans- 
form vector Yf=WtA.w • ■ - Y w,7.7l=E*+D,. where D<=[D,, 
i.o.o, .... D< 67i7 ] is the quantization error vector. 

The quantized vector Y, is input into an inverse DCT unit 
(724) and is further transformed to generate the vector y = 
[yu.o.0* • • • • yi^W^IYJ, where A" l [ ] is an inverse 
DCT. The pixels are determined according to: 

K.mv,=0-25 EX>£s.&l C(s) C{t) Y iXtit cos|7t<2m+l)j/16] cos 
|ic(2/i+l)t/l6]. 

The vector p, is input to a second adder (726) and is added 
30 to y, to obtain the reconstructed vector Zf=[z Mj0t0 , . . . , 
z l677 ]=y,+p i , and the pixels z,^^ are stored in the frame 
buffer (704). 

The quantized transform coefficients Y,^, arc typically 
encoded into a CBR bit stream, for example,' by utilizing a 
35 variable-length encoder (720) with an output buffer (722) 
and then transmitted (or stored). First the coefficients in each 
block are converted from the 8x8 matrix format into a serial 
format using what is known as *zig-zag scanning* (see FIG. 
9), and then the coefficients in each block are represented by 
40 a sequence of (Run, Level) values where "Run" represents 
the number of zeroes before the next non-zero value 
"Level." These (Run, Level) values are then encoded using 
a binary variable-length code. The output of the variable- 
length encoder is typically buffered (720) in order to gen- 
45 erate a CBR bit stream, and the quantization step size is 
adjusted by a quantizer control unit (718) to prevent buffer 
overflows (or underflows). The quantizer control unit (718) 
is operably coupled to the buffer (722) and provides an 
adjusting signal to the quantizer (716). 
50 In addition to the quantized transform coefficients Y rfXr r 
the encoder also transmits side information to allow the 
decoder to correctly reconstruct the coded signal. Side 
information includes the source format (CIF/QCIF), quan- 
tizer step size A,, inter/intra decision, motion vector m, (in 
55 inter mode only) and the loop filter in/out (when motion 
vector is present). 

The step size A, can be kept fixed for an entire GOB. In 
that case, only one step size value per GOB needs to be 
transmitted as side information. It is also possible to change 
60 A, inside the GOB. This provides a finer adjustment of the 
step size at the expense of a larger overhead. 

The H.261 encoder also transmits side information to 
allow the encoder skip a block or a MB. For example, when 
all the coefficients Y^, in an 8x8 block are zero, the 
65 encoder does not code these blocks at all. Similarly, when 
there is little motion, or when the motion estimation is nearly 
perfect, all coefficients in a MB may be zero. In that case, the 



The operation of the encoder in FIG. 7, numeral 700, for 
the i'th MB is described as follows: First, a motion estima- 
tion unit (702) utilizes an algorithm to determine a motion 
vector m/Km^, m^). Typically, the algorithm searches the 
luminance pixels in the previous reconstructed image (stored 
in a frame buffer (704)) to find a 16x16 window W, for 
which the "distance" between the pixels in that window and 
the corresponding pixels in the current MB is minimum. The 
motion vector mi represents the spatial offset between the 
window W, and the current (i'th) MB. 

The pixels that lie in the window W, form the motion- 
compensated vector u/=[Ui,i t o, 0 ' . . . . u^ 7i7 ] that is stored in 
the motion compensation unit (706). Thus, the motion 
estimation unit (702) is operably coupled to the frame buffer 
(704), and provides a motion compensated vector to the 
motion compensation unit (706), which is also operably 
coupled to the frame buffer (704). The mode unit (710) that 
is operably coupled to receive the input vector r ( - determines 
the encoding mode (Interflntra?). The prediction pHPf 1 ^ 
0, . . . , p/,6,7,71 of the input vector r, is obtained from u ( 
based on the encoding mode of the current MB: 

a. In the intra mode, set p^=0. 

b. In the inter (predictive) mode: 
bl. If the loop filter (708) is "out," set p,=u,. 
b2. If the loop filter (708) is "in," filter the elements of 

u, (block-by-block) using a separable, two-dimen- 
sional, 3-tap FIR filter, and set the output of the loop 
filter equal to p,. 
In each case, the loop filter (708) is operably coupled to 

the motion compensation unit (706) to operate as set forth 

above. 

At the first adder (712), the vector p, is subtracted from the 
input r, to obtain the prediction error vector ep[e Ut0iO , . . . 
f z. 67 7 ]=r.-p f . The vector e, is transformed to find E=[Ej. 
l.oi, . . . , E i677 ]=A[eJ, where A[ 1 here represents the 
Discrete Cosine transform (DCT) at a DCT unit (714) that 
is operably coupled to the first adder (712). The DCT is 
applied independently to each 8x8 block in the MB to obtain 
the transform coefficients E ( <JUif according to: 

fij^r=0-25 as) C(f) 22 0Sm,fl£7 r tjM cos|7t(2m+l)tf/16] cos 

where C(s)=l/V2 for s=0, and 1 otherwise, and C(l)=W2 for 
t=0, and 1 otherwise. Here s and t are the transform domain 
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encoder may skip the entire MB. When a block or a MB is 
skipped in the encoder, the decoder simply substitutes zeroes 
for the missing coefficients. 

The maximum image rate in H.261 is approximately 30 
images/sec, but the Recommendation allows the encoder to 5 
regularly skip 0, 1, 2 or 3 images to achieve effective image 
rates of 30, 1 5, 10 and 7.5 images/sec. The encoder may also 
skip an image occasionally. This can be used, for example, 
immediately after encoding an image in the intra mode. 
Since the intra mode typically generates a large number of 
bits, skipping an image can help reduce the buffering delay. 

The rate of a bit stream generated by an H.261 encoder 
can be changed using the transcoderof the present invention. 
A transcoder first decodes the received bit stream using a 
decoder for the variable-length code to obtain the sequence 
of (Run, Level) values, and then recovers the sequence of 15 
quantized vectors Y^fY, x 0 0 , . . . , Y Wi77 ] generated by the 
encoder. The decoder also recovers all side information. If a 
block or MB is not coded, the decoder inserts zeroes for the 
corresponding missing coefficients. 

Typical subsequent operations of the one-step transcoder 20 
are described below (see FTC 10, numeral 1000). A vari- 
able-length decoder (1002) outputs vector Y, to a first adder 
(1004) and provides framing information, inter/intra infor- 
mation, information about which blocks are coded (coded 
block pattern or CBP), step size A^, motion vectors m ( and 25 
loop filter information to various elements of the transcoder 
along a feedforward path. The first adder (1004) combines 
vector Y, and a modified quantization error vector S, to 
provide vector £/ to a quantizer (1006) and to a second 
adder (1014). The quantizer (1006) is operably coupled to 
the first adder (1004) and provides a quantized output vector 
Y/ to a variable-length encoder (1010) and to the second 
adder (1014). The variable length encoder (1010) is operably 
coupled to the quantizer (1006) and to receive information 
from the variable-length decoder (1002) and generates the 
output bits. The buffer (1012) is operably coupled to the 35 
variable- length encoder (1010) and provides a means for 
storing output bits before transmission and also provides an 
input to a quantizer control (1008). The quantizer control 
(1008) is operably coupled to the buffer (1012) and provides 
a control signal to the quantizer (1006) as described more 40 
fully above. The second adder (1014) is operably coupled to 
receive the vectors E/ and Y/ and provides D/=E/-Y ( '. An 
inverse DCT unit (1016) is operably coupled to the second 
adder (1014) and provides an inverse transform vector d/. 
The frame buffer (1018) is operably coupled to the inverse 45 
DCT unit (1016) and provides output vector z,. A motion 
compensation unit (1020) is operably coupled to the frame 
buffer and to receive a motion vector from the variable- 
length decoder (1002) and is utilized to provide an output 
vector w,. The loop filter (1022) is operably coupled to the 50 
motion compensation unit (1020), receives in/out loop filter 
information from the variable-length decoder (1002), and 
outputs the predicted quantization error vector s,. A DCT 
unit (1024)is operably coupled to the loop filter (1022) and 
outputs vector S,. 55 
The above-cited vectors are further described as follows: 
(1) No motion estimation is performed in the transcoder. 
Instead, the motion vector m i =(m n , received from 
the encoder is used to determine the 16x16 window W,, 
and the pixels in the transformed quantization error 60 
buffer (see below) that lie in that window are used to 
form the vector w/^w, , 0 0 , . . . , w, 6 7 7 ). Again, the 
motion vector m< represents the spatial offset between 
the window W ( and the current (i'th) MB. 
The predicted quantization error vector s^fs, a 00 , . . . , 65 
s, 6 7 7 1 is obtained from w, based on the encoding mode of 
the current MB: 
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a. In the intra mode, set s/=0. 

b. In the inter (predictive) mode: 

bl. If the loop filter is out, set s/=w,. 

b2. If the loop filter is in, filter the elements of w f 
(block-by-block) using a separable, two-dimensional 
3-tap FIR filter, and set the output of the filter equal 
to 5,. 

(2) The vector s, is transformed again to obtain the 
modified quantization error vector S,=A[sJ, where A I ] 
represents the DCT operation, according to: 

^ijt^tut co$|ic(2m+l)5/16] cos 

|ic(2n+l)i/l6]. 

(3) The modified quantization error vector S=fS r l 00l . . 

• « .6,7.7] IS subtracted from the coded vector' Y,. to 
obtain the error vector E/^fE',. A 0 0 E', 6 7 7 ]= Y^-S^. 

(4) The coefficients E\ M are (re)-quantized using an 
H.261 quantizer as in the encoder, possibly with a 
different step size A/, except for the term E' a 00 in the 
intra mode the same step size is used: A=A/==8. The 
result is the transcoded transform vector Y-=[Y\- 1 00 , . 

• * • YY 6i7i7 ]=E/+D/, where D/= [D' ia 0 0 , . . . , D',, 6t7t7 ] 
is the quantization noise vector for the transcoder. 

(5) The error vector E/ is subtracted from Y/ to obtain the 
quantization error vector D r \ and then D/ is inverse 
transformed using an inverse DCT to obtain d/=A _I 
ED/]: 

d\xmj,=0-25 n0Sj,|£7 as) at) Dutat coa[n<2m+l)j/16| cos 
|n(2«+l)i/16|; 

The pixels d' It are stored in a reconstructed quantization 
frame buffer for future iterations. 

In the following example, the transcoder uses the motion 
vector m t , the inter/intra decision and the loop filter decision 
received from the H.261 encoder without any modifications. 
The source format (CIF/QCIF) is also not modified. This 
greatly simplifies the implementation of the transcoder. 

The transcoder converts the transcoded sequence Y/ into 
a bit stream using a noiseless source encoder as in the H.261 
encoder. 

The bit stream generated by the transcoder is typically 
decoded by an H.261 decoder, as shown in FIG. 11, numeral 
1100. Here, after recovering the sequence Y/ from the 
received bit stream as usual, the decoder reconstructs the 
signal z/=[z Il i,o.o» * ■ • » ^t^J^M'. follows: 

(1) The received vector Y/, typically output by a variable- 
length decoder (1102), is first transformed using an 
inverse DCT unit (1104) that is operably coupled to the 
variable-length decoder (1102), wherein the inverse 
DCT unit (1104) determines an inverse DCT to obtain 
the vector yHy\ lJW . . . , y',-,6,7.7]: 

y'ijk^u.=0-25 ZI0Sj,f£7 C(j)OC0 Y\ta, cos[*(2m+t)j/16| cos 
[K(2n+lX/l6]. 

An adder (1106) is operably coupled to the inverse DCT 
unit (1104) and to a loop filter (1108) to combine Y f ' and p/, 
and generate output vector z f \ Vector z/ is an output of the 
H.261 decoder and is also utilized as a feedback vector to a 
frame buffer (1112). 

(2) A motion compensation unit (1110) is operably 
coupled to receive the output of the frame buffer (1112) 
and a motion vector m^m,,, m n ) from the encoder 
that is used to determine a 16x16 window W,. The 
pixels in the reconstruction buffer that lie in that 
window are used to form the vector u/=[u' Mj(M , 

U Vd.7. 7 ]- 
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A loop filter (1108) is operably coupled to the motion 
compensation unit (1110) for providing vector p,' to the 
adder (1106). The prediction value Pi-lpYi.ox* • • • - P't.6,ij] 
is obtained from u/ based on the encoding mode of the 
current MB: 5 

a. In the intra mode, set p/=0. 

b. In the predictive (inter) mode: 

bl. If the loop filter (1108) is out, set p/=u/. 

b2. If the loop filter (1108) is in, filter the elements of 
u/ (block-by-block) using a separable, two-dimen- io 
sional 3-tap FIR filter, and set the output of the filter 
equal to p/. 

(3) The vector p/ is added to y/ to obtain the reconstructed 
vector z/=y/+p/. 

The overall quantization error is then the sum of the 15 
quantization errors d, and d/ introduced by the encoder and 
the transcoder, respectively. 

FIG. 12, numeral 1200, is a flow chart of one embodiment 
of the steps in accordance with the method of the present 
invention. The method provides for transcoding a sequence 20 
of quantized vectors Y, generated by a predictive waveform 
encoder utilizing modified quantization error vectors S ( . The 
vectors cited below are described with greater particularity 
above. 

The method comprises the steps of: (1) generating a 25 
difference vector E/=Y,-S, between at least a first quantized 
vector Y, and a modified quantization error vector S, (1202); 
(2) quantizing the difference vector E,' to obtain a transcoded 
vector Y; (1204); (3) receiving at least two of the vectors Y ( , 
E/ and Y/and generating the inverse-transformed error 30 
vector d/sAf'PVL where D/ is a quantization error vector 
and A, -1 is an inverse transformation (1206); and generating 
the modified quantization error vector S ( based on past 
values of the vector d/ (1208). 

As described for the device of the present invention, the 35 
transformation A/" 1 may be selected to be constant, the 
quantized vector Y, may have dimensionality L=l, and the 
inverse transformation A, _1 [ ] may be an identity matrix. 

The step of generating the modified quantization error 
vector S t based on past values of the vector d/ may be 40 
selected to include: (1) generating a predicted quantization 
error vector s„ and (2) utilizing s, to generate a modified 
quantization error vector S, such that S ~=A f [sJ where A; is 
a predetermined transformation. In addition, this step may 
include one of (1H2): 45 
(1) utilizing received vectors Y/ and E/, for determining 
a quantization error D/=Y,'-E/ f and utilizing an inverse 
transformation A," 1 to generate the vector d/ according 
to d/sAr'ID,'], and (2) receiving and utilizing vectors 
Y, and Y/ for determining an error X^Y^'-Y,, utilizing 50 
inverse transformation A," 1 for generating a vector x t 
according to x=A, _1 [X/], and adding x, and s, to obtain 
the vector d/. 

The quantized vector Y, may be generated by a predictive 
digital video encoder and represents quantized transform 55 
coefficients of a macro block (MB), a fundamental coding 
element in H.261 . A motion-compensated prediction (MCP) 
may be utilized for prediction. Transformation A[ ] is a 
Discrete Cosine Transform (DCT). 

In one embodiment, the video encoder may be selected to 60 
be an H.261 encoder. 

The present invention may be embodied in other specific 
forms without departing from its spirit or essential charac- 
teristics. The described embodiments are to be considered in 
all respects only as illustrative and not restrictive. The scope 65 
of the invention is, therefore, indicated by the appended 
claims rather than by the foregoing description. All changes 
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which come within the meaning and range of equivalency of 
the claims are to be embraced within their scope. 
We claim: 

1. A device for transcoding a sequence of quantized 
vectors Y, generated by a predictive waveform encoder 
utilizing modified quantization error vectors S^, comprising: 

(A) an adder, operably coupled to receive at least a first 
quantized vector Y, and at least a first modified quan- 
tization error vector S„ for generating a difference 
vector E/=Y r S,- between the quantized vector Y f and 
the modified quantization error vector S f ; 

(B) a quantizer, operably coupled to the adder, for quan- 
tizing the difference vector E/ to obtain a transcoded 
vector Y-\ 

(C) a quantization error vector calculator (QEVC), oper- 
ably coupled to receive at least two of the vectors Y (f 
E; and Y ( \ for generating an inverse-transformed error 
vector d^Af^D/J, where D/ is a quantization error 
vector and A," 1 is an inverse transformation; and 

(D) modifying circuitry, operably coupled to the QEVC, 
for generating a modified quantization error vector S, 
based on past values of the vector d,\ where S ( is input 
to the adder. 

2. The device of claim 1, wherein said inverse transfor- 
mation A, -1 is constant. 

3. The device of claim 2, where the inverse transformation 
A" 1 is linear. 

4. The device of claim 3, wherein said quantized vector Y f 
has dimensionality L=l. 

5. The device of claim 4, wherein said inverse transfor- 
mation A,~ l is an identity matrix. 

6. The device of claim 3, wherein said modifying circuitry 
includes: 

a predictor, operably coupled to the quantization error 
vector calculator, for generating a predicted quantiza- 
tion error vector s,, and 

a transformation unit, operably coupled to the predictor, 
for utilizing a forward transformation A ( -[ ] for gener- 
ating the modified quantization error vector S f . 

7. The device of claim 6, wherein said quantization error 
vector calculator includes: 

a second adder, operably coupled to receive Y/ and E/, for 
determining the quantization error D ( '=Y/-E,\ and 

an inverse transformation unit, operably coupled to 
receive D,\ for utilizing an inverse transformation A,*" 1 
to generate the vector d/ according to d^A.'^D/]. 

8. The device of claim 6, wherein said quantization error 
vector calculator includes: 

a second adder, operably coupled to receive Y, and Y/, for 
determining an error X/=Y/-Y,, 

an inverse transformation A," 1 unit, operably coupled to 
the second adder, for generating a vector x, according 
to x^Af'pe;], and 

a third adder, operably coupled to receive the vector x, 
from the inverse u*ansformation unit and to receive a 
feedback signal spA, -1 !*/! from * e Predictor, for 
adding x, and s, to obtain the vector di'. 

9. The device of claim 6 wherein the quantized vector Y, 
is generated by a predictive digital video encoder. 

10. The device of claim 6 wherein said quantized vector 
Y,. represents quantized transform coefficients of a macro 
block (MB). 

11. The device of claim 9, wherein said predictor uses 
motion-compensated prediction (MCP) and transformation 
A[ ] is a Discrete Cosine Transform (DCT) and transforma- 
tion A" 1 is an inverse Discrete Cosine Transform (IDCT). 
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12. The device of claim 11, wherein said video encoder is 
an H.261 encoder. 

13. A method for transcoding a sequence of quantized 
vectors Yi generated by a predictive waveform encoder 
utilizing modified quantization error vectors S,-, comprising 
the steps of: 

(A) generating a difference vector E/=Y f -S, between at 
least a first quantized vector Y, and a modified quan- 
tization error vector S ( ; 

(B) quantizing the difference vector E/ to obtain a 
transcoded vector Y/; 

(C) receiving at least two of the vectors Y f , E/ and Y/ and 
generating an inverse-transformed error vector d/=A f ~ 
i[D/], where D/ is a quantization error vector and A," 1 
is an inverse transformation; and 

(D) generating the modified quantization error vector S, 
based on past values of the vector d/. 

14. The method of claim 13, wherein said inverse trans- 
formation A ( _1 is constant. 

15. The device of claim 14, where the inverse transfor- 
mation A^ 1 is linear. 

16. The method of claim 15 wherein said quantized vector 
Y ( has dimensionality L=l. 

17. The method of claim 16, wherein said inverse trans- 
formation A t ~ l is an identity matrix. 

18. The method of claim 15 wherein the step of generating 
the modified quantization error vector S f based on past 
values of the vector d/ includes: 

generating a predicted quantization error vector s f , and 
utilizing Si to generate the modified quantization error 
vector S ( such that S=A,[sJ where A, is a predeter- 
mined transformation. 

19. The method of claim 18, further including: 
utilizing received vectors Y/ and E/, for determining a 

quantization error D/^Y^-E/, and 
utilizing an inverse transformation A, -1 to generate the 
vector d/ according to d/=A,~ l [D ( -']. 

20. The method of claim 18, further including: 
receiving and utilizing vectors Y, and Y- for determining 

an error X/=Y/-Y,, 
utilizing inverse transformation A," 1 for generating a 

vector x, according to x/=A/" l [X,'], and 
adding x, and s, to obtain the vector d/. 

21. The method of claim 18 wherein the quantized vector 
Y, is generated by a predictive digital video encoder. 

22. The method of claim 18 wherein said quantized vector 
Y i represents quantized transform coefficients of a macro 
block (MB), a fundamental coding element in H.261. 

23. The method of claim 22, further including utilizing 
motion-compensated prediction (MCP), and wherein trans- 
formation A[ ] is a Discrete Cosine Transform (DCT) and 
transformation A -1 is an inverse Discrete Cosine Transform 
(IDCT). 

24. The method of claim 21, wherein said video encoder 
is an H.261 encoder. 

25. A transcoding device for converting a sequence of 
quantized vectors Y, generated by a predictive waveform 
encoder utilizing modified quantization error vectors S,, 60 
comprising: 

(A) an adder, operably coupled to receive at least a first 
quantized vector Y ( and at least a first modified quan- 
tization error vector S,, for generating a difference 



10 



15 



20 



25 



30 



35 



40 



45 



50 



55 



vector E/=Y,-S, between the quantized vector Y, and 
the modified quantization error vector S t ; 

(B) a generalized quantizer, operably coupled to the adder 
and having a quantization error vector calculator, for 
quantizing the difference vector E/ to obtain a 
transcoded vector Y t \ receiving at least one of the 
vectors Y, and E/, for generating an inverse-trans- 
formed error vector d/=A, -I [D/], where D/ is a quan- 
tization error vector and A,~ l is an inverse transforma- 
tion; and 

(C) modifying circuitry, operably coupling the quantiza- 
tion error vector calculator to the adder, for generating 
the modified quantization error vector S, based on past 
values of the vector d,\ 

26. The device of claim 25, wherein said inverse trans- 
formation A," 1 is constant. 

27. The device of claim 26, where the inverse transfor- 
mation A/ -1 is linear. 

28. The device of claim 27, wherein said quantized vector 
Y, has dimensionality D=l . 

29. The device of claim 28, wherein said inverse trans- 
formation A,-" 1 is an identity matrix. 

3D. The device of claim 27, wherein said modifying 
circuitry includes: 
a predictor, operably coupled to the generalized quantizer, 
for generating a predicted quantization error vector s,., 
and 

a transformation unit, operably coupled to the predictor, 
for utilizing a forward transformation A ( [ ] for gener- 
ating the modified quantization error vector S,. 

31. The device of claim 30, wherein said generalized 
quantizer includes: 

a quantizer, operably coupled to the adder, for quantizing 
an input vector E/ to provide Y,\ 

a second adder, operably coupled to receive E/ and Y/, for 
determining the quantization error D/-Y/-E/, where 
Y^ represents a quantized vector for an input E/ and 

an inverse transformation unit, operably coupled to 
receive D ( ', for utilizing an inverse transformation A,- -1 
to generate the vector d/ according to d,'=A ^[D/]. 

32. The device of claim 30, wherein said quantization 
error vector calculator includes: 

a second adder, operably coupled to receive Y ; and Y/, for 
determining an error X/=Y/-Y,, 

an inverse transformation A, -1 unit, operably coupled to 
the second adder, for generating a vector x ( . according 
to x/=A," lr X/], and 

a third adder, operably coupled to receive the vector x ^ 
from the inverse transformation unit and to receive a 
feedback signal s^A^fX/] from the predictor, for 
adding x, and s, to obtain the vector d/. 

33. The device of claim 30 wherein the quantized vector 
Y { is generated by a predictive digital video encoder. 

34. The device of claim 30 wherein said quantized vector 
Y f represents quantized transform coefficients of a macro 
block (MB). 

35. The device of claim 30, wherein said predictor uses 
motion-compensated prediction (MCP) and transformation 
A[ 1 is a Discrete Cosine Transform (DCT) and transforma- 
tion A" 1 is an inverse Discrete Cosine Transform (IDCT). 

36. The device of claim 33, wherein said video encoder is 
an H.261 encoder. 
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